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ABSTRACT 

An experimental Basic Electricity and Electronics 
course (BE/E) utilizing a lock-step, instructor presentation 
methodology was developed and evaluated at the Service School 
Command, Great Lakes. The study, directed toward the training of 
lower mental group, school nonqualified personnel, investigated 
comparative data on test performance, attitude, and attrition of 50 
students in an experimental group matched to a control group within 
the ongoing individualized BE/E training system. The results revealed 
significantly reduced attrition within the experimental group, 
control group, and overall Great Lakes BE/E School with no 
significant differences in quality of the graduates of the two 
treatment groups. Attitudinal data was generally positive for both 
groups and not significantly different. Two factors were concluded to 
be responsible for the program*s success: the focus of management 
attention to problems of training lower ability individuals in both 
groups, and the introduction of prestudy sessions into the 
experimental group. Appendixes (55 pages) include: statistical tables 
comparing test performance of the two groups, statistical analyses of 
test and attitudinal questionnaires items', instructor comments on the 
course, instructional materials readability and student reading 
ability, the prestudy concept, and cost breakdown for conducting the 
research. (Author/MS) 
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SUMMARY 



An oxporimontal Basic Electricity and Electronics Course utilizing a 
* iock-step, instructor presentation methodology was developed and evaluated 
at the Service School Command, Great Lakes. The study which was primarily 
directed toward the training of lower mental group, school non-qualified 
personno] investigated comparative data on test performance, attitude, and 
attrition of fifty students in an experimental group matched to a control 
group within the ongoing individualized BE/E training system. The results 
of this investigation revealed significantly reduced attrition within the 
experimental group, control group and overall Great Lakes BE/E School with 
no significant differences in quality of the graduates of the two treatment 
groups. Attitudinal data was in general positive for both groups and not 
significantly different. Two factors were concluded to be responsible for 
the succes.s of the experimental program: (1) the focus of management atten- 
tion to the problems of training the lower mental group, school non-qualified 
individual in the BE/E curriculum of both groups, and (2) the introduction of 
"pre-study" advance organizer lectures/instructor involved programmed instruc- 
tion into the experimental group. Due to the greater than fifty percent 
increase in cost (including increased staff personnel and increased training 
time) for the operation of a lock-step instructional system designed to train 
lower mental group, school non-qualified individuals in the BE/E curriculum, 
it appears that a more cost-effective approach would involve the modification 
- of the ongoing modular individualized system through the inclusion of the 
lock-.step proven "pre-scudy" concept and specialized management attention. 
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In addition to the findings, conclusions, and management considerations 
generated from this program, a formal instructor guide was developed, and 
studies were conducted on the readability of BE/E instructional modules and 
the content validity and item difficulty of BE/E test items* 
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Promoting Clio efficient utilization of available resources has long 
Ix'^Mi tlu' ^.oncern of the Naval Technical Training Command. This efficiency 
(an be measured through numerous criteria among which the rate of attrition 
aLliLeves considerable prominence. Accordingly, it was this criterion which 
ii reeled the CNTECHTRA Research Branch into an investigation of an ins true- 
Lioiiai methodology designed to facilitate the training of lower mental group, 
.school non-qualified personnel in the Basic Electricity and Electronics (BE/E) 
Curriculum. The primary impetus for this investigation conducted at the CM 
and BK/E Schools of Service School Command, Great Lakes, was an earlier sta- 
tistical breakdown of attrition by ratings within the three BE/E Schools at 
San Diego, Memphis, and Great Lakes. This earlier study had been brought 
.»boai by the disparity among the attrition rates at the three schools. Tables 
I and II present the results of the previous study which indicated excessive 

Table I 

BE/E SCHOOL ATTRITION 
(Jan-Jul 1974) 



Great Lakes Memphis San Diego COMMAND TOTAL 



;tudeut Kiow 


2989 


3210 


2579 


8778 


()VERi\LL ATTRITION 


17.9 


6.8 


11.3 


11.9 


bcliooi Academic Attrition 


9.6 


2.2 


9.8 . 


7.2 


School Non-Academic Attrition 


8.3 


4.6 


1.5 




/, School MG I and II Attrition 


5.7 


3.5 


3.8 


4.3 


% School MG III Attrition 


9.9 


2.4 


7.2 


6.5 


% School MG IV Attrition 


1.2 


.4 


.3 


.6 


% School MG Unknown Attrition 


1.1 


.5 




■' !. .5 
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attrition within the lower mental group and *'A" school non-qualified input 
to the Ureat Lakes, BE/E School. The analysis further revealed that the 
problem was in particular affecting the GM rating. 

i 

Table II 

SERVSCOLCOM GREAT LAKES - BE/E SCHOOL 
Attrition by Rates - January to July 





CTM 


EM 


ET 


GM 


IMS 


TM 


FT ! 

i 


RATINC ATTRITION 


3.0 


21.5 


6.4 


44.1 


34.4 


43.2 


9.4 


% Rating Academic Attrition 




13. A 


2.6 


24.3 


12.5 


28.4 


3.7 j 


% Rating Non-Academic Attrition 


3.0 


8.1 


3.8 


19.2 


21.9 


14.8 


i 

5.7 


% Rating MG I and H Attrition 


2.2 


4.0 


3.9 


8.6 


20.3 


23.4 


5.6 


% Rating MG HI Attrition 


.8 


13.6 


2.2 


30.4 


10.9 


16.0 


2.8 i 


% Rating MG IV Attrition 




2.5 




1.7 


1.6 


2.5 


1 

.6 ' 


Z Rating MG Unknown 






.3 








♦ 



Because the Class "A" schools fed by BE/E had indicated that the material 
taught in the BE/E curriculum was required for successful completion of the 
follow-on school and because a great number of students designated for particu- 
lar ratings failed in the BE/E phase, the currently employed BE/E instructional 
methodology became suspect. 

in light of the above, a formative evaluation was undertaken which in- 
volved the on-site development and appraisal of training system techniques 
which appeared to have a high probability of payoff in reducing attrition 
without a concurrent loss in student performance. Thus, the present study 
has been oriented around the development of a meaningful alternative to the 



self-paced modular instructional strategy of the BE/E School. This al- 
ternative Is based upon classroom Instructor presentation methods aug- 
mented with Intensive counseling, pre-study lecture/programmed Instruction, 
and remediation techniques* 

The conduct of this Investigation from September to November 1974 
required the selection of fifty matched pairs of subjects divided into an 
experimental group to receive lock-step, instructor taught classes at the 
GM School, Great Lakes, and a control group to receive the standard self- 
paced individualized instruction at the BE/E School, Great Lakes. Tables 
III and IV present a breakdown of the number of experimental and control 

Table III 

cuss "A" SCHOOL QUALIFIED AND NON-QUALIFIED 



2^ 

M 8* 



CLASS "A" 
SCHOOL 



QUALIFIED 



Experimental 



Control 



NON-QUALIFIED 



Experimental 



Control 



ET 
FT 
CT 



I 



+ lA 
■--I 



EM 
GM 



10 
6 



< o 
+ 



TM 
TMS 

TOTAL 



25 



25 



1 

3 

25 



I 

3 

25 



group subjects selected according to rating categories (grouped by "A" 
School entrance requirements), school qualified versus non-qualified en- 
trance scores, and mental group classifications. 

Table IV 
MENTAL GROUP CLASSIFICATION * 









MG 
EXP 


I 

CON 


MG 
EXP 


II 
CON 


MG 
EXP 


III 
CON 


MG 
EXP 


! 

IV 

CON 


Class 




School Qualified 


, 4 


4 


9 


9 


11 


11 


1 


1 


Class 


"A" 


School Non-Qualified 






4 


4 


19 


19 


2 


2 






TOTAL 


4 




13 


13 

1 


30 


30 


3 


3 



* Mental Group I OCT + ARI + MECH = 

Menta] Group II GCT + ARI + MECH = 

Mental Group III GCT + ARI + MECH = 

Mental Group IV GCT + ARI + MECH = 



194 and above 
163 - 193 
135 - 162 
104 - 134 



This study included certain highly complex developmental features. The 
reason is that it was concerned with the operation and evaluation of an 
evolving system. Thus it is necessary that the features of the study be 
shown in comparative format. These are summarized in Table V. Likewise, 
Table VI presents a listing of the comparative and supplementary data col- 
lected to support a comprehensive analysis of these factors. 
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Table V 



COURSE DESIGN 



EXPERIMENTAL GROUP 



CONTROL GROUP 



Selection 



Curriculum 



Teaching 
Methodology 

Supplementary 
Aids 



Testing 



Remediation 



Night Study 



Administration 



Counseling 

ERLC 



Representation of rating, "A" 
School qualification and mental 
group attrition problem areas 
(50 Ss), 

Standard BE/E narratives and 
summaries, labs and performance 
tests • 



Lock-step, instructor taught. 



Programmed instruction, instruc- 
tor prepared diagrams and trans- 
parencies, 

BE/E developed, objective type - 
group administered. 



Supervised, programmed instruc- 
tion and/or lectures. 



Pre-study, (consisting of 
advance organizer lectures and 
programmed instruction) re- 
quired of midterm failees for 
remainder of course and subse- 
quent test failees till pass- 
ing two consecutive modular 
tests, (See Appendix G) 

Grouping by classroom (Class A, 
fast group (GCT + ARI > 105) 
and Class B, slow group (GCT + 
ARI ^ 104)), Separate BEQ, 
Watch bill scheduled on non- 
interfering basis. 

Conducted by instructors and 
staff after each test failure. 



Matched to experimental 
group (50 Ss), 



Standard BE/E material~14 
Modules (programmed instruc- 
tion and/or narratives and 
summaries) labs and per- 
formance tests. 

Self-paced, individual study. 



Sound/slides (optional). 



BE/E developed-objective 
type - individually (self- 
administered) , 

Individualized study of modules 
(programmed instruction and/or 
narratives and summaries,) 

As required based on PCT 
(Projected Completion Time) 
and test failures. Individu- 
alized study of modules (pro- 
grammed instruction and/or 
narratives and summaries). 



Non-grouping, Self-paced, 



Conducted by instructors and 
staff as required. 



1? 



Table V - Continued 



^Academic Review 
Board 



Course Length 

Staf C/Studont 

Estimated Cost 
Per Student 



KXPERIMENTAL GROUP 

Consisted of administrative 
staff and student's instructor. 
Convened subsequent to midterm 
and final exam for those fail- 
ing. 

X = 35. 78 days 
1/10 

$2,374.00 



CONTROL GROUP 

Conducted by administrative 
staff as required. 



X = 27»27 days 
1/22 

$1,443.95 
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Table VI 



COLLECTION OF DATA 



STUDENT DATA 
Pre-Comprehensive Exam 

California Achievement Test (Reading Portion) 

Module Tests 

Remediation Tests 

Midterm Exam 

Post-Comprehensive Exam 

Attitudinal Questionnaire 

Working days required to complete course 

UAs/Attrites 



CONTROL 
GROUP 

X 
X 
X 
X 



X 
X 
X 
X 



EXPERIMENTAL 
GROUP 

X 
X 
X 
X 
X 
X 
X 
X 

» 

X 



MATERIAL DATA 

Readability of instructional materials 

1. Narratives and Summaries 

2. Programmed Instructions 

Content analysis of module test questions 
Percentage of students missing each question 
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riu- |.i iiiMiv.rttat isi icil analysis ol the ono.cla of tlio expcrinientaJ 
versus coiurol y.xxmp training systems has centerod upon analysis of 
variance teduiiques on the individual modular test scores and t-tests of 
significance on the comprehensive examination. These statistical proce- 
dures have been applied to overall experimental versus control group per- 
formance and to the subgroups of individuals, categorized according to 
school qualified versus non-qualified status, mental group classification, 
rating, and instructional class. 

Tables VU and VIII present the mean modular test scores (7. correct) 
for Che instructional class and pre-study categories of the experimental 
group only. 

Table VII 

MEAN MODULAR TEST SCORES (% CORRECT") FOR 
rNSTRUCTIONAL CLASSES IN EXPERIMENTAT. GROUP ONLY 





CLASS A 


CLASS B 


MOD 1 


91.36 


87.04 


MOD 2 


82.27 


78.53 


MOD 3 


86. 10 


78.74 


MOD 4 


91.60 


86.80 


M/M 


89.37 


84.32 


MOD 5-1 


91.76 


75.29 


MOD 5-2 


80.86 


84.29 


MOD 6 


78.26 


74.18 


MOD 7-1 


69.75 


60.75 


MOD 7-2 


92.00 


85.31 


MOD 8 


78.00 


73.60 


MOD 9 


79.54 


80.29 


MOD 10 


85.93 


82.06 


MOD 11-1 


84.98 


86.36 


MOD 11-2 


82.61 


80.71 


MOD 12-1 


82.61 


80.67 


MOD 12-2 


75.00 


88.75 


MOD 12-3 


81.37 


82.50 


MOD 13 


82.61 


83.00 


MOD 14-1 


86.96 


83.42 


MOD 14-2 


67.70 


71.67 
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Table VI II 



MKAN MODULAR TEST SCORES FOR EXl>ERIMENTAL 
GROUP Ss UNDER THREE LEVELS OF PRE-STUDY 





NO 


SOME 


AT,T, * 

{XXjXj 


i MODULE 

1 


PRE-STUDY 


PRE-STUDY 




; 1 


96.00 


89.33 




i 2 


91.67 


80.69 






92.11 


83.55 


68.42 




95.00 


91.25 




I M/M 


94.30 


87.06 


79 'M 


5-1 


93.63 


89.70 


52.11 


5-2 


89.88 


81.84 


79.59 


6 


88.88 


76.52 


60.39 


7-1 


78.13 


65.05 


53.57 


7-2 


96.67 


87.78 


80.00 


8 


83.00 


76.00 


60.00 


9 


91.67 


76.71 


72.28 


10 


89.71 


84.24 


73.94 


1 l-l 


93.94 


79.39 


85.71 


11-2 


95.24 


76.57 


79.59 


' 12-1 


92.36 


79.73 


72.38 


12-2 


87.50 


76.35 


91.67 


12-3 


89.29 


77.12 


73.86 


IJ 


87.50 


80.40 


84.29 


1/.-1 


89.91 


83.17 


86.49 


14-2 


75.78 


66.20 


72.79 



Subjects in this group were assigned to mandatory nightly "pre-study" 
sessions for entire second half of course. 



Appendix A presents the analyses of variance (two factor design with 
repeated measures on factor B) for those mean scores indicating the follow- 
ing: 

T- Instructional Class (In the case of significance for the primary factor 
(Class A - Fast Group versus Class B - Slow Group) the direction of the 
effect appeared to be in favor of the "Class A" group). 



ERLC 



A. Significant difference (p < ,05) between the experimental Class A 
and the experimental Class B for Modules 1-8 (including multimeter) , but 
not for Modules 9-14. (X^ 1-8 = 84.67, Xg 1-8 = 78.99) 

B. Significant difference (p < .01) across modules within the experi- 
mental Class A and experimental Class B for Modules 1-8 (including multi- 
meter), and Modules 9-14. 

C. Significant interaction (p < ,01) in experimental Class A and ex- 
perimental Class B Modules 1-8 (including multimeter), but not Modules 9-14. 
II. Pre-study Categories (In all cases of significance for the primary 
factor - amount of pre-study - the effect appeared to be in favor of those 
requiring less pre-study.) 

A. Significant differences (p < .01) between the "no pre-study" and 
"some pre-study" groups as well as the "some pre-study" and "all pre-study" 
groups for Modules 1-8 but only between the "no pre-study" and "some pre- 
study" groups in Modules 9-14. (X "^o pre-study" 1-8 = 90.84, X "gome pre- 
study" 1-8 = 82.62, X u^^^ pre-study" 1-8 = 68.45, ^ "no pre-study" 9-14 = 
89.29, X ^^sorne pre-study" 9-14 = 77.99) 

B. Significant differences (p < .01) across modules when subgrouped 
according to "no pre-study" versus "some pre-study" and "some pre-study" 
versus "all pre-study" for Modules 1-8 and "no pre-study" versus "some pre- 
study" only for Modules 9-14. 

C. Significant interactions (p <C .01) in "some pre-study" versus "all 
pre-study" Modules 1-8 only. 



Lihli';; IX, X, XI, aiul XII preseiil the mean modular test scores for 
Hit* oxjuM iincntiil versus control groups when subgrouped according to '^Mental 
Group,'* "Sdiool Qualification," "A** School scores," and "Pre-study, '* 
Analysis of variance (two factor design with repeated measures on factor B) 
for those mean scores indicated the following: 
!• Primary Factor Significance 

A, Significant differences between the experimental and control groups 
for Mcidules 1-8 (including multimeter) when subgrouped according to: 

1. MG IV (p < .05) X ^ 60.48, ^ Con = 82.12 

2. GCT •^ MECH + SP "A" School Qualification Scores (p < .05) 

^ Exp = 80.06, ^ Con = 83.42 

3. Pre-study students (prior to pre-study) (p <.01) 

^ Exp = 67.26, ^ Con = 81.49 

B. Significant differences between the experimental and control groups 

for Modules 9-14 when subgrouped according to: 

1. MG 111 (p ^ .01) X Exp = 81.22, X Con = 73.99 

2. "A" School Qualified (p < .01) X gxp = 83.87, X Con = 78.66 

3. GCT + MKCH + SP "A" School Qualification Scores (p < .01) 

^ Exp = 80.69, ^ Con = 74.02 
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Table IX 

MEAN MODULAR TEST SCORES {% CORRECT) 
FOR EXPERIMENTAL AND CONTROL GROUPS 
CLASSIFIED ACCORDING TO MENTAL GROUPS 











MENTAL 


GROUP 










MG I 


& II 


MG 


III 


MG 


IV 






EXP 


CON 


EXP 


CON 


EXP 


CON . 


MOD 


1 


9^.35 


96.50 


89.^7 


91.31 


6A.00 


9^.00 


MOD 


2 


86.67 


88. 5A 


78.67 


82. 18 


58.89 


81.67 


MOD 


3 


88.53 


93.^2 


80. 3A 


86.03 


68. A2 


8A.21 


MOD 




92.35 


93. 12 


91.00 


89.62 


66.67 


90.00 


M/M 




91. 6A 


88. 16 


85.96 


8A. 11 


68. A2 


86. 8A 


MOD 


5-1 


93.77 


93.73 


81.76 


90.^1 


A3. lA 


91. 18 


MOD 


5-2 


87.81 


77.68 


80.^8 


Ik. 12 


73.81 


63.69 


MOD 


6 


87. /t2 


79.52 


71.83 


66.67 


56.65 


69.22 


MOD 


7-1 


72.06 


78.52 


62.71 


70.^3 


52.08 


90.62 


MOD 


7-2 


95.29 


85.68 


87.78 


82.^0 


59.83 


76.92 


MOD 


8 


83.53 


82. 19 


73.67 


78.^6 


53.33 


75.00 


MOD 


9 


85.66 


89.02 


76.70 


75. 19 


73.52 


l(>.kl 


MOD 


10 : 


88.61 


87.06 


81.88 


75.30 


76. A7 


82.35 


MOD 


11-1 


88.07 


8^.80 


85.79 


83.26 


63. 6A 


86. OA 


MOD 


11-2 ; 


80.35 


86.66 


8^.62 


73.63 


71. A2 


57. lA j 


MOD 


12-1 


87.60 


8^.89 


79.73 


7^.60 


63. 3A 


86.66 


MOD 


12-2 


79. -'(6 


77.00 


81.67 


63. OA 


91.66 


83. 3A ' 


MOD 


12-3 


8 A. A 6 


68.93 


83. U 


62. A2 


50.00 


57. lA 


MOD 


13 


8/.. 67 


82.00 


82.00 


83. OA 


85.00 


80.00 


MOD 




85. 17 


11.5k 


8^.63 


83.23 


89. A8 


50.00 


MOD 


U>-2 


68.03 


60.39 


72.00 


66.20 


■ 68.80 


50.00 
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Table X 

MEAN MODULAR TEST SCORES (% CORRECtI 
FOR SCHOOL QUALIFIED VERSUS NON-QUALIFIED • 
EXPERIMENTAL AND CONTROL GROUPS ] 

j SCHOOL QUALIFICATION 

1 







QUALIFIED 


NON-QUALIFIED 






llAr 


CON 


EXP 


CON 


MOD 


1 




Q Q Q O 


Q O CO 

y 3. 5o 


87. 68 


MOD 


2 


83.33 


85.33 


83.34 


77.47 


MOD 


3 


86.32 


88.84 


88.36 


78.52 


MOD 




90.80 


91.20 


90.53 


87.60 


M/M 




88.84 


86.52 


84.62 


84.84 


MOD 


5-1 ; 


88.00 


92.69 


90.29 


79.05 


MOD 




86.28 


76.81 


73.31 


78.86 


MOD 




80.78 




67.09 


71.66 


MOD 


7-1 


72.25 


76.50 


71.38 


58.25 


MOD 


7-2 


90.40 


87.06 


80.04 


86.91 


MOD 


8 i 


77.00 


83.40 


74.74 


74.60 


MOD 


9 


83.12 


83.58 


76. 18 


77.20 


MOD 


10 


86.95 


80.25 


80.88 


79.78 


MOD 


11-1 


88.53 


83.28 


82.26 


85.02 


MOD 


11-2 


86.15 


78.57 


77. 14 


72.32 


MOD 


.12- 1 


85 ."22 


81.35 


77.67 


76.25 


MOD 


12-2 


81.88 


74.26 


80.83 


61.84 


MOD 


12-3 


83.52 


61.43 


80.00 


69. 35 


MOD 


13 


83.91 


83.75 


81? 50 


80.62 


MOD 


14-1 


89.47 


81.55 


80 (53 


78.62 


MOD 


14-2 


69.98 


64.09 


69.04 


61.83 ( 
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Table XI 

MEAN MODULAR TEST SCORES (% CORRECT) 
FOR EXPERIMENTAL AND CONTROL GROUPS 







CLASSIFIED 


BY "A" SCHOOL 


ENTRANCE 


CRITERIA 




1 

< 








"A" SCHOOL BTB SCORES 




1 

! 






ARI + 2 


ETST 


OCT + MECH + SP 


OCT + 


ARI 






(ET, FT, 


CT) 


(CM & EM) 


(TM & TMS) 






EXP 


CON 


EXP 


CON 


EXP 


CON 


MOD 


1 


—I 

92.20 


89. 79 


85.76 


93.71 


94.00 


90.52 


MOD 


2 


84 . 50 


88.24 


96.80 


81.59 


80.00 


81.67 


MOD 


3 


Q 7 on 


oy . 78 


78.10 


87.47 


77.63 


86.84 


MOD 




Q 1 nn 
V 1 . UU 


90. 78 


87.20 


92.38 


90.00 


85.00 


M/M 




88.57 


86.98 


85.47 


84.46 


84.21 


85.52 


MOD 


5-1 


90.59 


91.86 


78.11 


93. 17 


80. S8" 


82.35 


MOD 


5-2 


87. 14 


81.66 


80.00 


75.51 


71.77 


57.14 




A 

\j 


83.97 


73.04 


70.38 


72.22 


71.30 


57.26 


MOD 


7-1 


73.44 


77.52 


61.00 


70.24 


56.25 


76.56 


MOD 


7-2 


91.33 


83.08 


85.31 


85.70 


95.00 


78.08 


MOD 


8 


79.00 


78.51 


72.60 


81.19 


80.00 


75.00 


MOD 


9 


80.59 


85.61 


79.28 


77.59 


79.41 


61.26 


MOD 


10 


84.41 


81.08 


83.89 


78.99 


73.53 


65.94 


MOD 


ll-l 


87.24 


87.01 


84.19 


82.53 






MOD 


11-2 


81.43 


83.25 


81.98 


69.38 






MOD 


12-1 


84.00 


82.37 


79.71 


76.14 






MOD 


12-2 


76.67 


77.38 


85.51 


64.47 






MOD 


12-3 


80.71 


71.54 


82.92 


61.22 






MOD 


13 


84.58 


80.84 


81.30 


82.38 






MOD 


14-1 


89.74 


79.29 


81.46 


78.63 






MOD 


14-2 


72.76 


58.62 


66.67 


68.93 
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Table XII 



MEAN MODULAR TEST SCORES (% CORRECT) 

FOR MANDATORY PRE-STUDY 
EXPERIMENTAL Ss AND MATCHING CONTROLS . 





EXP 


CON 


MOD 


1 


76.89 


92.00 


: MOD 


2 


63.70 ■ 


80.37 


MOD 


3 


66.66 


80.70 


MOD 


4 


74.44 


90.00 


M/M 




77.49 


84.50 


MOD 


5-1 


48.69 


92. 12 


, MOD 


5-2 


77.76 


72.09 


i MOD 


6 


59.53 


75.36 


! MOD 


7-1 


55.56 


71.53 


MOD 


7-2 


76.98 


81.06 


MOD 


8 


62.22 


76.67 


MOD 


9 


72.27 


83. 19 


MOD 


10 


73.95 


80.67. 


MOD 


11-1 


85.72 


85.52 


MOD 


11-2 


79.59 


75.51 


. MOD 


12-1 


72.38 


83.81 


. MOD 


12-2 


91.67 


66.68 


' MOD 


12-3 


85.71 


63.26 


MOD 


13 


84.29 


92.86 


MOD 


14-1 


86.47 


82.82 


MOD 


14-2 


72.79 


75.51 
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1 1 . Seooudz^ry KacCor Significanco 

A. Signil'icant differences across modules within the experimental 
and control groups for Modules 1^8 (including multimeter) when subgrouped 
ciccording to: 

1. MG I & II (p < ,01) 

2. MG III (p ; .01) 

3. School Qualified (p ^' ,01) 

4. School Non-qualified (p < .01) 

5. ARl + 2 ETST "A" School Qualifications Scores (p ,01) 

6. GCT + MECH + SP "A'» School Qualification Scores (p ^ ,01) 

7. Pre-study students (p C ,01) 

B. Significant differences across modules within the experimental 
and control groups for Modules 9-14 when subgrouped according to: 

1. MG I & II (p ^ .01) 

2. MG III (p . ,01) 

3. School Qualified (p ^ ,01) 

4. School Non-qualified (p < ,01) 

5. ARI + 2 ETST "A" School Qualification Scores (p " ,01) 

6. GCT + MECH + SP "A" School Qualification Scores (p ,01) 
111. Signil'icant Interactions 

A. Significant interactions in the experimental and control groups 
for Modules 1-8 (including multimeter) when subgrouped according to: 

1. MG I & II (p ,01) 

2. MG III (p ,01) 

3. School Qualified -(p ,01) 

4. School Non-qualified (p ,01) 

ERLC 



5. ARI + 2 ETST "A" School Qualification Scores (p .05) 

6. GCT + MECH + SP ''A" School Qualification Scores (p ' .01) 

7. Pre-study students (p : .01) 

H. Significant interactions in the experimental and control groups 
for Modules 9-1^* when subgrouped according to: 

1. MG III (p . .01) 

2. School Qualified (p .01) 

3. GCT + MECH + SP '^A" School Qualification Scores (p .'oi) 

4. Pre-study students (p .01) 
iV. TM and IMS Rating Significance 

A significant difference (p .01) across modules, only, within the 
experimental and control groups for Modules 1-1 1 when subgrouped according 
to GCT + ARI ''A" School Qualification Scores. (This applies to TM and TMS 
ratings only.) 
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Vable XI II presents the means and standard deviations for the experi- 
mental and control groups by student categories on the pre-comprehensive, 
post-comprehensive, and post-comprehensive gain scores (% correct), T-tests 
of signilicnnce for the scores represented by these categories indicated 
the following: 
I. Comprehonsive Exams 

A. No significant differences between the experimental and control 
groups were found for the pre-comprehensive, post-comprehensive, and post- 
comprehensive gain scores grouped according to the following subcategories. 

1. MG I & II 

2. Hil III 

3. MG IV 

4. School Qualified 

5. Scliool Non-qualified * 

6. ART + 2 ETST "A" School Qualification Scores 

7. GOT + ARI "A" School Qualification Scores 

H. A significant difference between the experimental and control 
groups (p < .05) was found for the OCT + MECH + SP "A" School Qualification 
Scores subgroup on gain scores, only. The direction of this effect appeared 
to be in favor of the control group. 
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Table XIII 



MI.AN.S AND STANDAKl) DKVLATIONt; FOR MXIMJRTMENTAL AND CONTROL CROUPS 
U\ STIIDKNT CAThGORIES ON I'Rl'.-COMl'RKllKNSIVIi:, I'OST-COMPREHENSIVE, 
AND I'OST-COMI'REIIENSIVli: CAIN SCORES (% CORRECT) 



EXPERIMENTAL 



CONTROL 



ERIC 





X 


SD 


X 


SD 


Total Group 












Fro-Comp 


28.43 


10.82 


26.45 


13. 


22 


Post-Comp 


73.92 


14.36 


76.45 


10. 


11 


Gain 


45. 12 


15. 13 


50.28 


12. 


99 


Scliool Qualified 












Pre-Comp 


30.08 


13.28 


25.69 


14. 


10 


Post-Comp 


79.30 


12.41 


77.69 


10. 


32 


Gain 


48.91 


13.62 


52.00 


14. 


61 


School Non-Qualified 












Pre-Comp 


27.62 


6.92 


26.43 


13. 


76 


Post-Comp 


66.87 


14.32 


74.25 


9. 


95 


(Jai n 


39.69 


16.38 


47.38 


9. 


94 


MG I & II 












Pre-Comp 


31.00 


15.30 


28.57 


13. 


09 


Post-Comp 


79.28 


12.73 


82.64 


8. 


85 


Gain 


48.28 


14.97 


54.07 


13. 


04 


MG ITI 












Pre-Comp 


28.17 


8.32 


23.60 


14. 


38 


Post-Comp 


70182 


15.24 


72.47 


9. 


44 


Ga in 


42.65 


15.62 


48.86 


13. 


04 


MG IV 












Pre-Comp 


26.00 




35.50 


6. 


36 


Post-Comp 


77.50 


7. 77 


75.50 


7. 


77 


Gain 


51.50 


7.77 


40.00 


1. 


41 


FT/ET/CT 












Pre-Comp 


30.06 


15.61 


26.31 


13. 


19 


Post-Comp 


80.56 


14.11 


77.31 


9. 


53 


Gain 


50.50 


16.58 


51.00 


14. 


94 


EM/GM 












Pre-Comp 


28.38 


6.96 


25.80 


15. 


17 


Post-Comp 


69.66 


11.98 


76.42 


10. 


26 


Gain 


41.28 


12.15 


50.61 


11. 


59 


TM/TMS 












Pre-Comp 


28.50 


2. 12 


25.50 


2. 


12 


Post-Comp 


71.00 


31.11 


66.50 


16. 


26 


Gain 


42.50 


28.99 


41.00 


14. 


14 


19 
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In iuidltion to the analyses of modular and comprehensive exam scores, 
two other performance measures were examined. Descriptive statistics were 
compiled on a comparative basis to reveal any significant differences in 
attrition between the experimental and control groups and categories with- 
in these groups. Both descriptive and inferential statistics were computed 
on responses to the questions on an attitudinal questionnaire to determine 
any significant differences between the experimental and control groups. 

Attrition 

Table XIV presents a breakdown of the attrition for students in the 
experimental and control groups in terms of academic and non-academic 
categories as well as by mental group. As seen here, the control group 
had a 12 percent overall attrition as compared to the experimental which 
had only 8 percent. Both of these percentages of attrition were substan- 
tially below previous attrition rates for Great Lakes. 

Table XIV 

ATTRITION 



Overal 1 

Academic 

Non-Academic 



MG r & n 

MG III 
MG IV 



Experimental 
(GM School) 

% 

Drops Attrition 

A/50 8 

3/50 6 

1/50 2 

% Total 7, MG 
Drops Attrition Attrition 



0/17 
2/30 
2/3 



4 



6.5 
66.7 



Control 
(BE/E School) 

% 

Drops Attrition 

6/50 12 

5/50 10 

1/50 2 

% Total 7, MG 
Drops Attrition Attrition 



1/17 2 
4/30 8 
1/3 2 



5.9 
13.3 
33.3 
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Table XV examines attrition by ratings. Included on this Table are 
the rating attrition rates prior to the beginning of the study (Jan-Jul),- 
duriim Llie experiment (Sep-Oct), and the overall rates through October, 
rarlifularly noteworthy is the lower experimental group attrition in the 
CM racing. 

Table XV 
RATING ATTRITION 





EXPERIMENTAL 


JAN-JUL 


JAN-OCT 


SEP-OCT 


CONTROL 


ET 


12.50 


6.40 


5.08 


2.27 


8.30 


FX 


10.00 


9.40 


9.23 


8.64 


0 


cr 


0 


3.00 


2.29 


1.57 


0 


GM 


10.00 


44.10 . 


36.77 


37.55 


25.00 


EM 


6.70 


Z1.50 


t 

21.22 


21.42 


11.70 


TM 


0 


43.20 


33.33 


17.24 


25.00 


TMS 


0 


34.40 


22.70 


10.74 


0 



Attitudinal Questionnaire 
At the conclusion of the course both the experimental and control 
groups completed a questionnaire which focused upon indivi<5ual impressions 
and attitudes about the course, instructional material and instructional 
methodology. Table XVI summarizes the results. T-tests indicated no 
significant difference between the groups on the overall questionnaire, 
the instructors/learning center supervisors aspects, or the tests. The 
control group was found to be more in favor of existing classroom facili- 
ties (p .05) and BEQ arrangements (p .01) than the experimental. The 
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experimental group was more in favor of the training materials (p ,05) 
and the general operating procedures (p " ,05) of their course. 

Table XVI 
STUDENT ATTITUDE QUESTIONNAIRE* 



I 
I 

EXPERIMENTAL CONTRO: 
COURSE ASPECT GROUP GROUP 



Tns tTUc tors /Learning 


X 




2.00 


X 




7 7 1 


Center Supervisors- 
















SD 




.42 


SD 




.50 


Training Materials 


X 




2.52 


X 




2.81 




SD 




.36 


SD 




.63 


Classrooms 


X 




3.81 


X 




2.89 




SD 




1.64 


SD 




.63 


Tests 


X 




2.52 


X 




2.44 




SD 




.70 


SD 




.62 


BEQ 


X 




4.47 


X 




3.23 




SD 




1.46 


SD 




.85 


In General 


X 




2.99 


X 




3.41 




SD 




.54 


SD 




.81 



* Responses were scored on a scale of 1-7. Lower scores indicate 
more positive responses. 
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- . DISCUSSION 

The results of the statistical analyses on the modular test scores 
indicate that the present BE/E system of individualized instruction is 
as effective for school qualified, school non-qualified, Mental Group I, 
II, and III and TM, FT, ET, and CT rating categories as traditional 
classroom instruction for the first eight modules of the BE/E curriculum. 
Furthermore, Mental Group IV and EM and GM category students in the 
individualized instruction group appear to respond significantly better 
than their counterparts in the classroom situation in Modules 1-8. This 
trend is reversed, however, during Modules 9-14, where the Mental Group IV 
category individuals do equally well in the classroom situation as in the 
individualized system, and the school qualified. Mental Group III and EM/GM 
category individuals significantly outperform their counterparts in the 
individualized system. The most probable cause for this reversal effect 
appears to be in either an increasing instructional effectiveness with the 
increasing difficulty of the modules, or the introduction of pre-study 
lectures/programmed instruction for the second half of the course. Analysis 
of the pre-study group only reveals significant differences in favor 
of the matching control for the first half of the course, but not for the 
second half when mandatory nightly pre-study sessions were in effect. This 
finding, coupled with the analysis of modular test scores classified according 
to amount of pre-study received, lends strong support to the contention 
that the pre-study advance organizer lectures/programmed instruction were 
responsible for the effect. The rationale behind this contention lies in 
the significant differences favoring the lesser pre-study groups during the 
first 8 modules (when pre-study was not in effect), but not in Modules 9-14. 
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OBSERVATIONS AND CONCLUSIONS 

A. Statements based -on results of study: 

1. Coincident with the conduct of the formative evaluation of an 
experimental lock step BE/E program, attrition was significantly 
reduced not only in the experimental group but in the control 
group and overall Great Lakes BE/E School as well. 

2. The quality of the graduates of the experimental BE/E program, as 
measured by modular and comprehensive test performance, was not 
significantly different from that of the control group. 

3. The cost (including increased staff personnel and increased 
training time) for the operation of a lock step instructional 
system designed to train lower mental group, school non-qualified 
individuals in the BE/E curriculum appears to involve greater 
than a fifty percent increase in financial resources. 

4. The focus of management attention to the problems of training 
the lower mental group, school non-qualified individual in the 
BE/E curriculum appears to be a significant factor in reducing 
attrition. 

5. The pre-study concept (advance organizer lectures/programmed 
instruction) significantly improves test performance for the 
lock step instructor taught BE/E. 

6. Indications are that the most cost-effective approach to the 
training of lower mental group school non-qualified individuals 
in the BE/E curriculum would involve the modification of the 
on-going modular individualized system through the inclusion of 
the lock step proven *'pre-study" concept and specialized manage- 
ment attention. 
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7, In general, student attitudes toward both the experimental lock 
step system and the ongoing individualized system for BE/E 
were equivalent and positive. 

B. By-products of study; 

1. Formal instructor guide 

2. Readability study of module programmed instruction and narratives/ 
summaries (See Appendix F) 

3. Pre-study concept (See Appendix G) 

4. Content validity and item difficulty check on test items (See 
Appendix C) 

5. Data on conditions contributing toward attitude development and 
the learning environment (See Appendix D) 

C. Continuing analysis of data: 

Longitudinal study continuation. NAVPERSRANDCEN San Diego to track 
through "A" school and fleet. 
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MANAGEMENT CONSIDERATIONS 



The potential impact of the findings from the foregoing study appears 
to have value for the Navy if applied in the following manner. First, 
the development and successful implementation of the *'pre-study" concept, 
as previously described, offers the training system a supplementary 
strategy designed for and validated upon low performers. Its value is 
clearly defined in terms of reduced attrition and increased performance 
scores. Thus, it is recoimnended that the "pre-study" concept already 
demonstrated within the experimental, lock step BE/E instructional system 
be adapted for and evaluated within the on-going modular, individualized 
BE/E system as a supplementary aid for low performers. Note that the 
success experienced with this concept has been with "pre-study" preceding 
rather than following modular tests. 

More importantly from a management point of view is the cost 
perspective which emerges from this effort. As the purpose of the study 
was to find a way to train the lower mental group, school non-qualified 
individual in the BE/E curriculum, every effort was made to achieve this 
criterion by providing whatever resources were required. One of these 
resources was time. The experimental training cycle average 35.78 days 
as opposed to 27.27 days for the training of a matched group within the 
on-going modular system. This time would have been considerably greater 
if the classroom lectures had not been supplemented by hours of afternoon 
remediation and evening "pre-study." The addition of these components 
to the training system further increased the requirement for staff 
personnel resources from a 1/22 ratio to a 1/10 ratio. Undoubtedly, the 
increased costs (estimated to be more than 50 percent) for the training 
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of the fifty experimental group students would diminish if operationalized 
on a large scale, but probably not more than a few percentage points* Thus, 
the fifty percent increase in required resources appears to be a reasonable 
approximation of the cost of training lower mental-group, school non- 
qualified individuals in an instructor taught, lock step B£/£ curriculum* 
While the cost of operating the necessary adaptation of the on-going 
modular individualized system is presently unknown, the requirement for 
incorporating components of the experimental lock-step system virtually 
assures a substantial increase in resource demands* 

Finally, there are several management considerations emerging from 
this study which are directed toward the optimization of conditions within 
the on-going modular, individualized B£/£ training system* One of these 
factors is readability* It is apparent that there is a mismatch between 
the reading grade level of large numbers of individuals and the readability 

of the self-study modules particularly the prograimned instruction. This 

mismatch is probably even more serious than indicated by the California 
Reading Test which was not specifically designed for the population tested* 
Clearly, management needs to take action to insure the earliest possible 
re-write of these materials to approximate the ninth grade level as 
measured by the recently derived Navy Readability Indices* Such action 
can be expected to increase the comprehension of technical training 
materials thereby increasing learning and reducing attrition* This 
approach, however, can only reflect positive changes in learning when the 
content validity and item difficulty of the B£/£ tests have been optimized. 
Analysis of a sample of these tests has revealed that they fall short in 

these areas • In light of the above, it is recommended that management 
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L<ike L!mne(li<ite corrective action toward the rewrite of the test items in 
CDiuioiuuuH' with the objectives. 

(!le<jrlv, the trcuning community is capable of handling the lower mental 
V.roup, schouJ non-qualified individuals, but only when the necessary resources 
(instructors, support personnel, time, and money) are provided and directed 
toward the adaptation of the system to their needs* ' 

In summary, it appears that the pre-study, advance organizer lectures/ 
programmed instruction were responsible for the success of the lecture- 
oriented classroom instructional system. Although such factors as limited 
time and other resources may have tended to obscure the potential effective- 
ness of such teaching methods for certain categories of students, it appears 
that the pre-study was a factor of even greater importance. Generalizing 
to tlie present modular individualized BE/E system, it is reasonable to ex- 
pect a similar contribution from the incorporation of the pre-study concept. 
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APPENDIX A 



ANALYSIS OF VARIANCE SUMMARY TABLES FOR MODULAR TEST COMPARISONS 
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6S 



CONTENT VALIDITY ANALYSIS OF BE/E TEST ITEMS 

(Prepared by GMl Jarrett) 
SUBJECT: TEST ITEM DISCREPANCIES SERIES "E" 



TEST 

1- E (Item 10) Answer "D" should read "lamp'' vice ''load'* 

2- E (Item 19) Question relates to objective ''2-1-1" vice "2/3/1" 

3- E (All Items) Satisfactory 

4- E (All Items) Satisfactory 

5- E (All Items) Satisfactory (5-1-E and 5-2-E) 
6E (Item 18) Repetitious of Item 17 

7-1-E (Item 7-16) VA's over half of the test are not supported by narrative, 
PI> summary or objectives. VA is an important concept for the under- 
standing of troubleshooting and should be properly implemented into 
Module 7, Also in order for equal question weight, there should bo 
several VA's with 3-4 questions relating to each, 
NOTE: If Ohmic Value is changed, that resistor should be shown as 
variable. 



7-2-E 


(Item 4-13) 


(See 7-1-E above) 


8-E 


(All Items) 


Satisfactory 


9-E 


(All Items) 


Satisfactory 


lO-E 


(All Items) 


Satisfactory 


11-E 


(All Items) 


Satisfactory (U-l-E and 11-2-E) 



12-1-E (Item 8) Reverse vector triangle vice |\^ ^ 

12-2-E (Item 27) Question relates to objective "12-6-1" vice 12-3-2" and 
belongs with test 12-2-E 

12- 3-E (All Items) Satisfactory 

13- E (Item 3) Question should read "1 ufd" vice "1 uh" 

(Item 10) Answer "D" « vice F - 

o - o ^ I ' 

Vlic Vlc 

NOTE: Answer is a "Draw Answer" but within 4% of correct answer 
(i.e., Fq = ,159 
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TEST 

14-1-E (Item 10-19) (See 7-1-E) 

14-2-E (Item 2) Answer "C" to read "1^ to equal I^" vice "Xj^ to equal X^" 
(Item 12-21) (See 7-1-E) 

SUBJECT: TEST ITEM DISCREPANCIES SERIES "G" FINAL 



TEST 



(Item 14) Question to read "... and a DC generator" vice and 
a generator" 

(Item 45) Answer "A" to read "changing magnetic field" vice "magnetic 
field" 



SUBJECT: TEST ITEM DISCREPANCIES SERIES "D" 

TEST 

1- D (All Items) Satisfactory 

2- D (Item 6) Delete or rewrite 
3D (All Items) Satisfactory 

. 4D (All Items) Satisfactory 

M/M (All Items) Satisfactory 

5D (All Items) (5-1-D and 5-2-D) 

6D (All Items) Satisfactory 

7-1-D (Item 7-16) (See 7-1-E) 

7-2-D (Item 4-15) (See 7-1-E) 

8D (Item 9) Rewrite question: Lenz's law relates to I not E^ 

9- D (Item 8) Schematic should show switch at Position 2 

10- D (All Items) Satisfactory 

11- 1-D (All Items) Satisfactory 

11-2-D (Item a) Change question to read "pfd" vice "uufd" 
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TEST 

12-1-D (Item 15) Objective is "12-3-1" vice "12-2-1" 

12-2~D (All Items) Satisfactory 

12- 3-D (All Items) Satisfactory 

13- D (All Items) Satisfactory 

14- 1-D (Item 3). Change all answers, to read "VA" vice "VARS' 

(Item 10-19) (See 7-1-E) 

14-2-D (Item 12-21) (See 7-i-E) 
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It is quite evident that the tests are not a fair measure of a student's com- 
prehension in Modules 7 and 14, so far as variational analyses are concerned. 

The method for testing of variational analysis is of a matrix type, whereby, 
a trainee missing the first few answer^ of a group will fail the entire test. 

The VAs used in Modules 7 and 14 represent over half of each test and the 
student's records of comprehension substantiate this problem. The test 
failure problem is compounded by the fact that some objectives are covered 
on the tests, but to a degree, not in keeping with materials covered by 
instruction or programmed instruction, nor consistent with the time alloca- 
tion on particular material. 

A coordinated effort should be made by instructors, examination and objective 
writers to validate the tests so that they provide a more objective indication 
of a student's comprehension. 
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APPENDIX D 



ITEM ANALYSIS OF ATTITUDINAL QUESTIONNAIRE 

0 
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NUMBER AND PERCENTAGE OF EXPERIMENTAL GROUP Ss RESPONDING TO EACH POSITION 
OF THE SEMANTIC DIFFERENTIAL ON INDIVIDUAL COURSE ASPECT ITEMS 



COURSE ASPECT ; INSTRUCTORS /LEARNING SUPERVISORS 

(33) (8) (4) (2) 
Knows Subject Matter 70.21 ; il.j02: 8.51 ; 4^26; 0: 0; 0; Doesn't Know Subject 

Matter 

(2) (1) '(3) (10) (31) 

Poorly Educated 0; 4.26 ; 0; 2.13 ; 6.38 ; 21.28 ; 65.96 ; Well Educated 

(21) (15) (6) (4) (1) 
Well Organized 44.68 ; 31.91 ; 12.77 ; 8.51 ; 2.13 ; 0: 0: Poorly Organized 

(17) (9) (9) (4) (4) (2) (1) 
Easy to Understand 36.96 : 19.15 ; 19.15 ; 8.70 ; 8.70 : 4.35 ; 2.17 : Hard to Understand 

(1) (4) (11) (31) 
Doesn't Use Examples 0; 0; 0; 2.13 ; 8.51 ; 23.40 ; 65.96 ; Uses Examples 

(1) (5) (3) (8) (30) 

Not Interested in Subject 0; 2.13 ; 0; 10.64 : 6.38 ; 17.02 ; 68.33 : Interested In 

(13) (14) (9) (4) (3) (2) (1) 
Clear 28.26 : 30.43 : 19.15 : 8.70 ; 6.52 ; 4.35 ; 2.17 ; Confusing 

(1) (1) (6) (8) (19) (12) 
Doesn't Give Training 0: 2A3: 2.13 ; 12.77 : 17.02 : 40.43 : 25.53 : Gives Training 
Objectives Objectives 

(32) (10) (3) (2) (1) 
Experienced 69.57 : 21.74 ; 6.52 : 4.35 : O; 0: 2. 17 ; Inexperienced 

(30) (11) (6) (1) 
Gives Individual Help 63.83 ; 23.40 ; 12.77 : 0; 0; 2A3: 0: Doesn't Give Individual Help 

(33) (8) (4) (1) (1) 
MiBvers Questions 70.21 : 17.02 ; 8.51 : 2., 13: 2. 13 ; 0: 0; Evades Questions 

(1) (2) (4) (6) (4) (18) (11) 
ooring 2A7 : 4.35 : 8.70 ; 13.04 ; 8.70 : 39.13 : 23.91 ; Interesting 

(15) (14) (6) (10) (1) 
Incerested in You 32.61 ; 30.43 : 13.04 ; 21.74 ; ^J7; 0; 0: Uninterested in You 

(1) (1) (1) (6) (22) (14) 

IJiacouraging 2.22 ; 0: 2.22 : 2.22 : 13.33 ; 48.89 : 31.11 ; Motivating 
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COURSE ASPECT! 



TRAINING MATERIALS 



(24) (11) (7) (4) (1) (1) 
Related to Course 50.00 : 22.92 ; 14.58 ; 83.33 : 2.08 ; 2.08 ; 0: Unrelated to Course 
Objectives Objectives 

(15) (15) (14) (4) (1) 
Teach Performance 30.61 ; 30,61 ; 28.57 ; 8.16 ; 0; 2^: 0: Do Not Teach Performance 

(4) (2) (2) (3) (15) (11) (12) 
Do Not Support Lectures 8.16 ; 4.08 ; 4.08 ; 6.12 ; 30.61 ; 22.45 ; 24.49 : Supports Lectures 

(2) (3) (3) (10) (11) (12) (8) 
No Variation 4.08 : 6.12 ; 6.12 ; 20.41 ; 22.45 ; 24.49 ; 16.33 : Lots of Variation 

(3) (1) (6) (16) (13) (8) 
Not Understandable 0: 6^; 2JJ; 12.77 ; 34.04 : 27.66 : 17.02 ; Understandable 

(17) (13) (7) (5) (3) (2) (1) 
Current 35.42 : 27.08 : 14.58 ; 10.42 ; 6.25 ; 4.17 : 2.08 ; Out-of-Date 

(13) (14) (12) (4) (3) 
Well Illustrated 27.08 : 29.17 ; 25.00 ; 8.33 ; 10.42 ; 0; 0; Poorly Illustrated 

(1) (2) (7) (10) (13) (15) 
Shallow 0; 2^; 4J7; 14.58 ; 20.83 ; 27.08 ; 31.25 ; Detailed 

COURSE ASPECT ; CLASSROOMS 

(2) (2) (3) (3) (2) (7) (29) 
Too Small 4.17 ; 4.17 ; 6.25 ; 6.25 ; 4.17 : 14.58 ; 60.42 ; Large Enough 

(25) (9) (4) (5) (2) (2) (1) 
Too Hot or Too Cold 52.08; 18.75 ; 8^: ' 10.42 ; 4.17 ; 4.17 ; 2.08 : Comfortable Temperature 

(31) (13) (1) (1) (2) 
Sufficient Lighting 64.58 : 27.08 ; 2.08 : 2.08 ; 0; 4J7; 0: Insufficient Lighting 

(3) (5) (3) (6) (8) (8) (15) 
Well Ventilated 6^: 10.42 ; 6.25 ; 12.50 ; 16.67 ; 16.67 ; 31.25 ; Poorly Ventilated 

(7) (12) (4) (6) (2) (4) (13) 
Comfortable Furniture 14.58 ; 25.00 ; 8.33 ; 12.50 ; 4.17 ; 8.33 : 27.08 ; Uncomfortable 

Furniture 

(9) (7) (3) (12) (10) (4) (3) 
Noisy 18.75 ; 14.58 ; 6.25 : 25.00 ; 20.83 ; 8.33 ; 6.25 ; Quiet 



COURSE ASPECT; 



TESTS 



(2) (2) (6) (4) (10) (15) (9) 

Not Understandable 4J7: 4J7: 12.50 : 8.33 : 20.83 : 31.25 : 18.75 ; Understandable 

(13) (13) (7) (7) (3) (3) (1) 

Reflect What You Should 27.66 ; 27.66 : 14.89 ; 14.89 ; 6.38 : 6.38 : 2.12 ; Do Not Reflect 
' You Should Know 

(37) (7) (2) (1) (1) 

Time to Finish 77.08 ; 14.58 ; 0; 4.17 ; 2.08 : 0: 2.08 : No Time to Finish 



COURSE ASPECT ; beQ 

(5) (2) (5) (8) (4) (6) (18) 
Too Small 10.42 ; 4J7; 10.42 ; 16.67 : 8.33 : 12.50 : 37.50 ; Large Enough 

(21) (5) (7) (6) (3) (2) (4) 
Too Hot or Too Cold 43.75; 10.42 : 14.58 ; 12.50 ; 6.25 ; 4.17 : 8.33 ; Comfortable Temperature 

(16) (3) (6) (5) (3) (6) (8) 
Insufficient Lighting 34.04 ; 6^; 12.77 ; 10.64 ; 6.38 : 12.77 ; 17.02 : Sufficient Lighting 

(8) (3) (6) (8) (7) (6) (9) 
Well Ventilated 17.02 ; 6^: 12.77 ; 17.02 : 14.89 : 12.77 ; 19.15 : Poorly Ventilated 



Uncomfortable 21.28; 8.51; 8.51; 17.02: 8.51; 14.89; 21.28; Comfortable Furniture 
Furniture 



(1) W (3) (7) (33) 

Quiet 0: 2.08 : 0: 8.33 : 6.25 ; 14.58 ; 68.75 : Noisy 

(2) (3) (4) (5) (2) (10) (21) 

Clean 4.26 ; 6.38 ; 8.51 : 10.64 : 4.26 : 21.28 ; 44.68 : Dirty 



Insufficient Recreation 79.17: 10.42: 4.17; 4.17; 0: 4.17; 4.17: Sufficient Recreation 
Facilities Facilities 

(1) (5) (6) (6) (9) (20) 

Good Study Conditions 2J3; 10.64 : 0; 12.77 ; 12.77 ; 19.15 ; 42.55 ; Poor Study Conditions 

(26) (3) (3) (3) (1) (5) (7) 
Unreasonable Watch Bill 54.17 ; 6^: 6^: 6^: 2j08; 10.42 : 14.58 : Reasonable Watch Bill 

(28) (9) (3) (5) (2) (1) 
Friendly Classmates 58.33 : 18.75 : 6.25 ; 10.42 : 4.17 ; 0: 2^: Unfriendly Classmates 

(2) (3) (8) (3) (16) (16) 
Poor Class Spirit _0; 4J7: 6^: 16.67 : 6.25 ; 33.33 : 33.33 ; Good Class Spirit 

69 
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COURSE ASPECT; 



IN GENERAL 



(11) (14) (11) (6) (3) (1) (2) 
Provides for Individual 22.92 ; 29.17 ; 22.92 ; 12.50 ; 6.25 ; 2.08 ; 4.17 ; Doesn't Provide 

For Individual 

(12) (12)- (4) (3) (6) (6) (5) 
Comfortable Pace 25.00; 25.00 ; 8^ 6^; 12.50 ; 12.50 ; 10.42 ; Too Fast or Too Slow 

(1'9) (14) (7) (5) (2) (1) 
Will Help as Civilian 39.58; 29.17 ; 14.58 ; 10.42 ; 4.17 ; 0; 2^; Won't Help as Civilian 

(5) (3) (3) (7) (10) (10) (9) 
Ignores Your Skills 10.64 ; 6^; 6^; 14.89 ; 21.28 ; 21.28 ; 19.15 ; Uses Your Skill 

(6) (1) (3) (9) (9) (14) (6) 
Ignores Your Background 12.50 ; 2^; 6^: 18.75 ; 18.75 ; 29.17 ; 12.50 ; Uses Your Back- 
ground 

(2) (3) (4) (16) (14) (9) 

Unenjoyable 4J7; 0; 6^; 8^; 33.33 ; 29.17 ; 18.75 ; Enjoyable 

(2) (10) (5) (11) (9) (7) (4) 
Easy 4J7; 20.83 ; 10.42 ; 22.92 ; 18.75 ; 14.58 ; 8.33 ; Difficult 

(3) (4) (9) (6) (17) (9) 

Boring 6^: 8^; 0; 18.75 ; 12.50 ; 35.42 ; 18.75 ; Interesting 

(17) (9) (5) (8) (3) (2) (4) 
Better Than High 35^; _18^; _10^: ^6^: 4^. 8.33; Worse Than High School 
School ° 

„ (1) (2) (3) (6) (11) (21) 

Would Not Like More 8^: 2^; 4J7; 6^; 12.50 ; 22.92 ; 43.75 ; Would Like More Train- 
Training Like This ing Like This 



70 



o 77 

:RJC 



NUMBER AND PERCENTAGE OF CONTROL GROUP Ss RESPONDING TO EACH POSITION 
OF THE SEMANTIC DIFFERENTIAL ON INDIVIDUAL COURSE ASPECT ITEMS 



COURSE ASPECT ; INSTRUCTORS/LEARNING SUPE RVISORS 

(20) (7) (2) (1) 
Knows Subject Matter 66.67 ; 23.33 ; 6.67 ; 0: 0: 0; 3^; Doesn't Know Subject Matter 

(1) (3) (3) (7) (16) 

Poorly Educated 3.33 ; 10.00 ; 0: 0; 10.00 ; 23.33 ; 53.33 ; Well Educated 

(15) (7) (4) (3) (1) 
Well Organized 50.00 ; 23.33 ; 13.33 ; 10.00 ; 3.33 ; 0; 0; Poorly Organized 

(11) (7) (4) (2) (5) (1) 
Easy to Understand 36.61 ; 23.33 ; 13.33 ; 6.67 ; 16.67 ; 0: 3.33; Hard to Understand 



(3) (1) (2) (4) (8) (12) 

Doesn t Use Examples 10.00 ; 3^13; 6^; 0; 13.33 ; 26.67 ; 40.00 ; Uses Examples 

(3) (1) (1) (7) (18) 

Not Interested in Subject 10.00 ; 3.33 ; 0; 0; 3^13; 23.33 ; 60.00 : Interested in Subje 

(7) (10) (5) (1) (3) (2) (2) 
Clear 23.33 ; 33.33 ; 16.67 ; 3.33 ; 10.00 ; 6.67 ; 6.67 ; Confusing ' 

(1) (4) (2) (4) (9) (10) 

Doesn't Give Training 2J3; 13.33 ; 0; 6^; 13.33 ; 30.00 ; 33.33 ; Gives Training 
Objectives Objectives 

(18) (8) (4) 
Experienced 60.00 ; 26.67 ; 13.33 ; 0; 0; 0; 0; Inexperienced 

(20) (5) (1) (3) (1) 
Gives Individual Help 66.67 ; 16.67; 3.33 ; 10.00 ; 3.33 ; 0; 0; Doesn't Give Individual 

Help 

(21) (3) (3) (1) (1) (1) 
Answers Questions 70.00 ; 10.00 ; 10.00 ; 3.33 ; 3.33 ; 0; 3.33 ; Evades Questions 

(2) (3) (2) (3) (5) (10) (5) 
Boring 6.67 ; 10.00 ; 6.67 ; 10.00 ; 16,67 ; 33.33 ; 16.67 ; Interesting 

(13) (6) (2) (5) (1) (2) 
Interested in You 44.83 ; 20.69 ; 6.90 ; 17.24 ; 3.45 ; 6.90 ; 0; Uninterested in You 

(3) (6) (2) (4) (15) 
Discouraging 0; 0; 10.00 ; 20.00 ; 6.67 ; 13.33 ; 50.00 ; Motivating 
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COURSE ASPECT ; TRAINING MATERIALS 

(14) (8) (6) (2) 
Related to Course Objectives 46.67 ; 26.67 ; 20.00 ; 6.67 ; 0: 0: Oi Unrelated to Course 

Objectives 

(9) (7) (9) (2) (1) (2) 
* Teach Performance 30.00 ; 23.33 ; 30.00 ; 6.67 ; 3.33 ; 6.67 ; 0; Do Not Teach Performance 



(3) (4) (7) (6) (7) (3) 

Do Not Support Lectures 10.00 ; 13.33 ; 0; 23.33 ; 20.00 ; 23.33 ; 10.00 ; Supports Lectures 

(2) (2X (1) (8) (4) (8) (5) 
No Variation 6.67 ; 6.67 ; 3^13: 26.67 ; 13.33 ; 26.67 ; 16.67 ; Lots of Variation 

(1) (5) (5) (12) (2) (5) 

Not Understandable 3.33 ; 16.67 ; 16.67 ; 0; 40.00; 6.67; 16.67; Understandable 



(14) (6) (5) (2) (2) (1) 
Current 46.67 ; 20.00 ; 16.67 ; 6.67 ; 6.67; 3.33; 0; Out-of-Date 



(9) (8) (5) (1) (3) (4) 

Well Illustrated 30.00 ; 26.67 ; 16.67 ; 3.33 ; 0; 10.00 ; 13.33 ; Poorly Illustrated 

(1) (2) (5) (4) (14) (4) 
Shallow 0; 3.33 ; 6.67 ; 16.67 ; 13.33 ; 46.67; 13.33; Detailed 



COURSE ASPECT ; CLASSROOMS 

(2) (3) (1) (2) (3) (7) (12) 
Too Small 6.67 ; 10.00 ; 3.33 ; 6.67 ; 10.00 ; 23.33 ; 40.00 ; Large Enough 

(5) (3) (2) (4) (5) (3) (8) 
Too Hot or Too Cold 16.67 ; 10.00 ; 6.67 ; 13.33 ; 16.67 ; 10.00 ; 26.67 ; Comfortable Temperature 

(18) (3) (3) (1) (3) (2) 

Sufficient Lighting 60.00 ; 10.00 ; 10.00 ; 3.33 ; 0; 10.00 ; 6.67 ; Insufficient Lighting 

(12) (5) (3) (2) (2) (5) (1) 
Well Ventilated 40.00 ; 16.67 ; 10.00 : 6.67 ; 6.67 ; 16.67 ; 3.33 ; Poorly Ventilated 

(8) (4) (5) (2) (5) (6) 

Comfortable Furniture 26.67 ; 13.33 ; 16.67 ; 6.67 ; 0; 16.67 : 20.00 ; Uncomfortable Furniture 

(3) (1) (3) (13) (10) 

Noisy 0; 10.00 ; 0; 3.33 ; 10.00 ; 43.33 ; 33.33 ; Quiet 



: COURSE ASPECT : TESTS 

(1) (2) (3) (3) (5) (11) (5) 
Not Understandable 3.33 ; 6.67 ; 10.00 ; 10.00 ; 16.67 ; 36.67 ; 16.67 ; Understandable 
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COURSE ASPECT: 



TESTS (CONTINUED) 



(7) (17) (1) (3) (1) (1) 
Reflect What you Should 23.33 ; 56.67 : 3.33 : 10.00 ; 3.33 : 0; 3.33 ; Do Not Reflect You 

Should Know 

(22) (4) (2) (1) (1) 

Time to Finish 73.33 ; 13.33 : 6.67 ; 0; 0: 3.33 ; 3.33 ; No Time to Finish 

COURSE ASPECT : BEQ 

(5) (2) (2) (1) (6) (14) 

Too Small 16.67 ; 6.67 ; 6.67 ; 0; 3.33 ; 20.00 ; 46.67 : Large Enough 

(8) (2) (3) (2) (2) (6) (7) 
Too Hot or Too Cold 26.67 ; 6^: 10.00 ; 6.67 ; 6.67 : 20.00 ; 23.33 : Comfortable Temperature 

W (1) (2) (1) (3) (6) (13) 
Insufficient Lighting 13.33 : 3.33 : 6.67 : 3.33 : 10.00 ; 20.00 ; 43.33 : Sufficient Lighting 

(8) (5) (4) (5) (3) (1) (4) 
Well Ventilated 26.67 ; 16.67 : 13.33 ; 16.67 ; 10.00 ; 3.33 ; 13.33 : Poorly Ventilated 

(4) (4) (2) (3) (3) (5) (9) 
Uncomfortable 13.33 : 13.33 ; 6j67; 10.00 ; 10.00 : 16.67 : 30.00 : Comfortable Furniture 
Furniture 

(3) (4) (1) (2) (7) (2) (11) 
Quiet 10.00 ; 13.33 ; 3.33 ; 6.67 ; 23.33 ; 6.67 ; 36.67 : Noisy 

(9) (12) (2) (3) (1) (3) 

Clean 30.00 ; 40.00 ; 6.67 ; 10.00 : 0; 3.33 : 10.00 ; Dirty 

(9) (2) (1) (5) (5) (2) (6) 
Insufficient Recreation 30.00 ; 6.67 ; 3.33 ; 16.67 : 16.67 : 6.67 ; 20 . 00 ; Sufficient Recreation 
Facilities Facilities 

(4) (3) (2) (5) (1) (5) (5) 
Good Studjr, -Conditions 13.33 ; 26.67 ; 6.67 : 16.67 : 3.33 : 16.67 ; 16.67 : Poor Study Conditions 

(3) (1) (3) (5) (2)" (6) (10) 
Unreasonable Watch Bill 10.00 ; 3.33 : 10.00 ; 16.67 ; 6.67 ; 20.00 ; 33.33 ; Reasonable Watch 

Bill 

(18) (7) (2) (2) (1) 
Friendly Classmates 60.00 ; 23.33 ; 6.67 ; 6.67 ; 3.33 ; 0; 0; Unfriendly Classmates 

,^ (1) (2) (10) (2) (8) (7) 

Y^-r Class Spirit 0: 3.33 : 6.67 ; 33.33 ; 6.67 ; 26.67; 23.33; Good Class Spirit 



COURSE ASPECT : IN GENERAL 

(5) (13) (5) (2) (2) (1) (2) 
Provides for Individual 16.67; 43.33 ; 16.67 : 6.67; 6.67: 3.33 ; 6.67 ; Doeon't Provide 

for Individual 

, , <2) W (4) (5) (3) (9) 

Comfortable Pace 10^; 6^: U^; U^S: i6^: IQ.QQ ; 30.00 ; Too Fast or Too Slow 

(15) (7) (3) (3) (1) (1) 

Will Help as Civilian 50^; 23^; JOjOO; 1^0; 0; 2L33; 3^: Won't Help as Civilian 

(2) (3) (5) (4) (7) (9) 
Ignores Your Skills 0: 6^: 10.00 ; 16.67 : 13.33 : 23.33 ; 30.00 ; Uses Your Skills 

V „ , , (5) (4) (2) (7) (4) 

Ignores Your Background 13.33: 13.33 ; 16.67 ; 13.33 ; 6.67 : 23.33 ; U.Jii Uses Your Back- 
ground 

(2) (3) (2) (8) (6) (6) (3) 
Unenjoyable 6^; 10.00 ; 6A7; 26.67 : 20.00 : 20.00 ; 10.00 ; Enjoyable 

(3) (1) (3) (6) (8) (3) (6) 
Easy 10.00: 3.33: 10.00 ; 20.00 ; 26.67 ; 10.00 ; 20.00 : Difficult 

(5) (3) (1) (5) (14) (2) 

Boring 16.67: 0: 10.00 : 3.33 : 16.67 ; 46.67 : 6.67 ; Interesting 

(11) (3) (4) (2) (4) (4) (2) 
Better Than High 36J^: iOjOO; 13^; 6^: U^: ^orse Than High School 



u ,j „ , (2) (3) (6) (3) (5) (8) 

T?u J^?*" Training 10.00 ; 6^; 10.00 ; 20.00 ; 10.00 ; 16.67 : 26.67 ; Would Like 

Like This 



More Training 
Like This 
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INSTRUCTOR COMMENTS ON EXPERIMENTAL BE/E COURSE 
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INSTRUCTOR COMMENTS ON EXPERIMENTAL BE/E COURSE 

* GMMl Smith 

1. "I believe this one factor (pre-study) contributed heavily to the success 
of this course." 

2. "Reevaluation and revision (of tests) is needed because some of the 
tests do not reflect time allocations and th'er depth to which some of the 
subject matter is covered. In several areas instruction is considerably 
more detailed tzhan the knowledge factor needed to successfully pass the 
examination." 

ETC Duvall 

1. "The single factor which I feel helped many of the T/Es complete the 
course was the fact that those who were considered in academic trouble were 
assigned to compulsory night study and forced to prepare for the next day's 
lesson. " 

GMMl Jarrett 

1. "The Basic Electricity and Electronics Course of instruction recently 
completed at Gunner's Mate School indicates that, if used as a multimedia 
for the slower learners> could establish a higher degree of understanding 
and lower the attrition rate." 

2. "Since lock step instruction reduces the demand on a student's reading 
comprehension, the slower reader is utilizing the classroom environment to 
subsidize his learning." 
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3. "With this in mind, some basic criteria should be set forth to preclude' 
the faster learner from using lock-step instruction as the "simple way" 
through BE/E.'^'- ^^^ 

4. "The most dominant problem areas were those directly involving learning 
objectives and testing. Many of the objectives are very broad and under 
instructional conditions, allow an excessive amount of deviation while still 
meeting the objectives." 

5. "Considering the minimum of advance preparation, for materials and 
support facilities and instructors, the program was relatively free of 
problems and could be considered a complete success." 

G MTl Benfield 

i* "I believe the course did help some of the students to get through BE/E 
School who, if went through the regular prlgram of instruction would not 
have made it. The course supports the fact that a pre-study of the modules 
helped a lot of the students to get through the second half of the course, 
and to understand it more, where if they had had the pre-study on the slower 
students on the first half where most of the basic laws are learned, they 
would have had better results of the first half and the midterm." 
2. "The course also supports the fact that the instructor does have a lot 
of influence on the student, from the number of students that changed their 
rate to Gunners Mate, just because their instructor and the classes were 
held in the Gunner's Mate School, which they would relate to the rate more 
than they could to the ones they were going to." 
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APPENDIX F 



MODULE READABILITY AND STUDENT READING ABILITY 
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Table F-1 presents the readability grade levels of both the narrative/ 
summary and programmed instruction portions of the instructional modules 
presently used in the BE/E training system. This data was derived from a 
ten percent sample of the modules through the application of the recently 
modified version of the Automated Flesch Count which was designed specifically 
for Navy use. In consideration of the fact that this formula tends to 
predict lower readability grade levels than conventional formulae, and the 
California reading test tends to predict higher reading ability levels 
than would be expected for this population, the resulting mismatch is 
significant. Note also, that this mismatch is in terms of mean grade 
levels and is much more serious for a number of individuals. Particularly 
interesting is the finding that the programmed instruction is generally 
more difficult than the narratives and summaries. 
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Table F-1 

MODULE READABILITY AND STUDENT READING ABILITY 



Automated Flesch Count (modified for Navy use). 



MODULE GRADE LEVEL 





SUMMARY/ 






NARRATIVE 


PI 


1 


7.95 


9.86 


2 


9.64 


8.41 


3 


8.67 


12.48 


4 


9.45 


11.51 


5 


8.63 


12.16 


6 


9.48 


7.95 


7 


9.60 


11.69 


8 


9.72 


12.97 


9 


10.45 


11.29 


10 


10.50 


11.96 


11 


11.52 


13.45 


12 


11.19 


14.57 


13 


9.44 


11.40 


14" 


10.44 


13.39 



CALIFORNIA READING TEST 
(MEAN GRADE LEVEL) 
"SLOW GROUP" "FAST GROUP" 

EXPERIMENTAL CONTROL EXPERIMENTAL CONTROL 

X- 10.12 X-9.70 X - 12.79 X - 13.10 
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APPENDIX G 



"Pre-study" Concept 
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"Pre-study" 

The "pre-study" concept was instituted within the experimental group 
subsequent to the failure of nine individuals to meet the prescribed 
criterion on the raid- term examination. Investigation into the learning 
difficulties experienced by these and other individuals revealed both 
a lack of preparation outside of class and a general lack of success with 
remediation. Accordingly, the Acaderaic Review Board assigned these 
individuals to attend nightly two and one-half hour "pre-study" sessions 
for remainder of the course. It was further determined that all individuals 
failing a subsequent modular test would be required to attend nightly 
"pre-study" sessions till passing two consecutive modular tests. The 
purpose of these nightly "pre-study" sessions was to provide advance 
organizers in the form of "overview" lectures and instructor-involved 
programmed instruction. In practice, the lectures usually amounted to 
approximately ten percent of the study time. 'Although the remainder of 
the time involved programmed instruction, it should be noted that this 
was of a much more interactive nature than that of the traditional role 
situation of learning center supervisors. One other pertinent point in 
this regard is that the "pre-study" was designed to increase the probability 
of success on an upcoming test prior to the experience of failure with a 
particular module rather than after-the-fact. Thus there is an important 
motivational aspect inherent within this procedure. 
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APPENDIX H 



COST BREAKDOWN FOR CONDUCT OF FORMATIVE 
EVALUATION OF EXPERIMENTAL BE/E PROGRAM 
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COST BREAKDOWN FOR CONDUCT OF FORMATIVE 
EVALUATION OF EXPERIMENTAL BE/E PROGRAM 



Project Manager 
(LT - 56 days) 

Experimental Group Coordinator 
(Li" - 56 days) 

Controi Group Coordinator 
(GS-9 - 67 days) 

Research Assistant 
(CPO - 10 days) 

Research Assistant 
(CPO - 3 days) 



Salary TAD 
$ 4,026.40 $1,016.33 



4,026.40 



499.30 



149.79 



996.51 



3,872.60 1,074.90 



256.42 



179.17 



hSlLlATLD TOTAL COST - $16,635.54 
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$12,574.49 $3,523.33 



Technicdl Assistants for Instructor Guide 
(2 POls - CNTECHTRA funded TAD) 



$ 537.72 
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An experimental Basic Electricity and Electronics Course utilizing a lock-step, 
instructor presentation methodology was developed and evaluated at the Service 
School Command, Great Lakes. The study which was primarily directed toward the 
training of lower mental group, school non-qualified personnel investigated compara- 
tive data on test performance, attitude, and attrition of fifty students in an 
experimental group matched to a control group within the ongoing individualized 
BE/E training system. The results of this investigation revealed significantly 
reduced attrition within the experimental group> control group and overall Great 
Lakes BE/E School with no significant differences in quality of the graduates of 
the two treatment groups. Attitudinal data was in general positive for both groups 
and not significantly different. Two factors were concluded to be responsible for 
the success of the experimental program: (1) the focus of management attention 
to the problems of training the lower mental group, school non-qualified individual 
in the BE/E curriculum of both groups, and (2) the introduction of "pre-study" 
advance organizer lectures/instructor involved programmed instruction into the 
experimental group. 
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